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Allowable Subject Matter 

1 . Claims 1-44 are allowed. 

The following is an examiner's statement of reasons for allowance: 

The present invention relates to techniques for providing users of client 
devices with coordinated access to information and/or functionality of multiple types, 
such as by using multiple types of connections to multiple information services of 
distinct types that exchange context information related to activities of the users 
and/or clients. The client devices can be wireless devices with multiple distinct modes 
such voice and data modes for different types of connections with different types of 
servers such as voice servers and data servers. In some situations, coordination 
between different servers allows multiple distinct interaction sessions of different 
types with different servers to remain synchronized or othen/vise coordinated over 
time as the user performs interactions via the different sessions. 

The closest prior art, Hyde-Thomson et al. (hereinafter Hyde-Thomson) (US 
6,477,494) shows a communications systems for receiving voice and text messages, 
automatically identifies a language associated with text messages and selectively 
providing text-to-speech converted messages and voice messages to users. 

Regarding claim 1, Hyde-Thomson fails to disclose or suggest "...a method for 
providing voice-based and text-based functionality to a mobile wireless client computing 
device from multiple remote servers in a coordinated manner, the client device having a 
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current user and supporting a data mode for exchanging text-based information with a 
remote data server system and supporting a voice mode for exchanging voice-based 
information with a remote voice server system, the method comprising the steps of: 
under control of the mobile wireless client computing device, establishing a data 
connection with the data server using the data mode of the client device, and receiving 
multiple text-based documents from the data server over the established data 
connection; receiving an indication from the current user of a selection of one of multiple 
voice-based actions for a selected one of the text-based documents, automatically 
sending to the data server over the established data connection an indication of the 
selected document and of the selected action; and without further indication by the 
client device of the selected action or the selected document, automatically establishing 
a voice connection with the voice server using the voice mode of the client device and 
receiving voice-based information from the voice server over the established voice 
connection to effect the selected voice-based action for the selected text-based 
document; under control of the remote data server system and after receiving the 
indication from the client device of the selected text-based document and of the 
selected voice-based action, automatically sending context information for the current 
user to the voice server, the context information including an indication of the selected 
text-based document and of the selected voice-based action; and under control of the 
remote voice server system and after receiving the context information for the current 
user from the data server and after the establishment of the voice connection with the 
client device, identifying that the current user is using the client device; automatically 
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associating the received context information for the current user with the established 
voice connection with the client device; and providing the selected voice-based action 
for the selected text-based document to the current user based at least in part on the 
associated context information, the providing including automatically sending the voice- 
based information to the client device over the established voice connection, so that a 
user of a mobile wireless client computing device can automatically receive voice-based 
functionality for a selected text-based document based at least in part on context 
information for the user that is automatically provided by a data server to a distinct voice 
server. 

Claims 2-1 1 are allowed by virtue of their dependency on claim 1 . 

Regarding claim 12, Hyde-Thomson fails to show a method for providing 
functionality from a voice server system and a data server system in a coordinated 
manner, the voice server system able to exchange voice-based information with 
multiple client devices using a voice transmission protocol designed for transmitting 
voice-based data, the data server system able to exchange text-based information with 
multiple client devices using a distinct data transmission protocol, the method 
comprising, under control of the data server system: providing multiple predefined text- 
based groups of information to a client device, the providing part of a data session with 
the client device using the data transmission protocol; receiving from the client device 
an indication of one of the text-based groups of information and an indication of one of 
multiple voice-based types of functionality related to the indicated text-based group of 
information, the receiving part of the data session; and automatically providing to the 
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voice server system context infomnation that includes an indication of the indicated text- 
based group of information and of the indicated voice-based type of functionality, so that 
the voice server system can automatically provide the indicated voice-based type of 
functionality for the indicated text-based group of information as part of a voice session 
with the client device using the voice transmission protocol. 

Claims 13-31 are allowed by virtue of their dependency on claim 12. 

Regarding claim 32, Hyde-Thomson fails to show a computer-readable medium 
whose contents cause a server computing device of a first type to provide functionality 
in a coordinated manner from one or more other servers, communications between the 
server computing device of the first type and one or more clients occurring in a distinct 
manner than communications between the other servers and one or more clients, the 
providing of the functionality under control of the server computing device by performing 
a method comprising: receiving from a client an indication of a group of information 
indicated by a user and an indication of a selected functionality related to the indicated 
group of information, the receiving of the information based on a first manner of 
communication between the client and the server computing device, the selected 
functionality available from one or more of the other servers when a client 
communicates with at least one of those other servers in a second manner that is 
associated with the selected functionality and that is distinct from the first manner of 
communication; and automatically providing context information to at least one of the 
one or more other servers that includes an indication of the indicated group of 
information and of the selected functionality, so that the one or more other servers can 
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automatically provide the selected functionality for the indicated group of information 
when a client of the user and those other servers communicate in the distinct second 
manner of communication associated with the selected functionality. 

Claims 33-40 are allowed by virtue of their dependency on claim 32. 

Regarding claim 41, Hyde-Thomson fails to disclose a computing system for 
providing functionality in a coordinated manner from multiple servers of distinct types, 
comprising a voice server that is capable of exchanging voice-based information with 
client devices using a voice-based transmission protocol; a data server that is capable 
of exchanging non-voice-based information with client devices using a data-based 
transmission protocol; and a context provider component that is capable of at least one 
of: 

A) after the data server has received an indication from a client device using the 
data-based transmission protocol of a selected type of functionality that is available from 
the voice server using the voice-based transmission protocol, providing information to 
the voice server indicating the selected type of functionality and at least one of the client 
device and a user of the client device, the information provided to the voice server 
enabling the voice server to automatically provide the selected type of functionality 
using the voice-based transmission protocol without the client device and/or the user 
having to further indicate the selected type of functionality to the voice server; and 

B) after the voice server has received an indication from a client device using the 
voice-based transmission protocol of a selected type of functionality that is available 
from the data server using the data-based transmission protocol, providing information 
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to the data server indicating the selected type of functionality and at least one of the 
client device and a user of the client device, the information provided to the data sender 
enabling the data server to automatically provide the selected type of functionality using 
the data-based transmission protocol without the client device or the user having to 
further indicate the selected type of functionality to the data server. 

Claim 42 is allowed by virtue of their dependency on claim 41 . 

Regarding claim 43, Hyde-Thomson fails to disclose a computing system for 
providing functionality in a coordinated manner from a voice server and a data server, 
the voice server capable of exchanging voice-based information with clients using a 
voice transmission protocol, the data server capable of exchanging other types of 
information with clients using a distinct data transmission protocol, comprising means 
for, after one of the servers has provided information to a client using the transmission 
protocol for that server, receiving from the client using that transmission protocol an 
indication of a selected type of functionality related to the information, the selected 
functionality type available from the other server using the transmission protocol for that 
other server; and means for automatically providing context information to that other 
server that includes an indication of the selected type of functionality and of the related 
information and of an identifier associated with the client, so that the other server can 
automatically provide to the client the selected type of functionality for the related 
information using the transmission protocol for that other server. 

Regarding claim 44, Hyde-Thomson fails to disclose a method for providing 
information to client devices from a voice server system and a data server system in a 
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coordinated manner, the voice server capable of exchanging voice-based information 
with client devices using a voice mode, the data server capable of exchanging text- 
based information with client devices using a distinct data mode, the method comprising 
under control of the data server, repeatedly, exchanging text-based information as part 
of a data session with a client device of a user using the data mode; providing 
information to the voice server that indicates at least some of the exchanged text-based 
information; receiving information from the voice server that indicates voice-based 
information exchanged by the voice server with a client device of the user using the 
voice mode as part of a simultaneous voice session; and selecting additional text-based 
information to be provided as part of the data session with the client device using the 
data mode, the selecting based at least in part on the received information from the 
voice server; and under control of the voice server, repeatedly, exchanging voice-based 
information as part of the voice session with the client device of the user using the voice 
mode; providing information to the data server that indicates at least some of the 
exchanged voice-based information; receiving information from the data server that 
indicates text-based information exchanged by the data server with the client device 
using the data mode as part of the data session; and selecting additional voice-based 
information to be provided as part of the voice session with the client device using the 
voice mode, the selecting based at least in part on the received information from the 
data server. 
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Conclusion 



Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sonny TRINH whose telephone number is 571-272- 
7927. The examiner can normally be reached on Monday-Thursday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Edward URBAN can be reached on 571-272-7899. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-dlrect.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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